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Abstract 

The MAP algorithm is a trellis-based maximum a posteriori probability decoding al- 
gorithm. It is the heart of the turbo (or iterative) decoding which achieves an error 
performance near the Shannon limit. Unfortunately, the implementation of this algorithm 
requires large computation and storage. Furthermore, its forward and backward recursions 
result in long decoding delay. For practical applications, this decoding algorithm must be 
simplified and its decoding complexity and delay must be reduced. In this paper, the 
MAP algorithm and its variations, such as Log-MAP and Max-Log-MAP algorithms, are 
first applied to sectionalized trellises for linear block codes and carried out as two-stage 
decodings. Using the structural properties of properly sectionalized trellises, the decoding 
complexity and delay of the MAP algorithms can be reduced. Computation-wise optimum 
sectionalizations of a trellis for MAP algorithms are investigated. Also presented in this 
paper are bi-directional and parallel MAP decodings. 




1 Introduction 


Maximum likelihood decoding (MLD) minimizes the block ( or sequence) error probability, 
however, it does not necessarily minimize the bit (or symbol) error probability. It only delivers 
hard decoded bits, called hard outputs, without providing their reliability measures. In many 
error control coding schemes, it is desirable to provide both decoded bits and their reliability 
values, called soft outputs, for further processing to improve the system error performance. 
A decoding algorithm that allows to process soft-decision inputs and produces soft-decision 
outputs is called a soft-in/soft-out (SISO) decoding algorithm. The most well known SISO 
decoding algorithm is the MAP (maximum a posteriori probability) decoding algorithm that 
was devised by Bahl, Cocke, Jelinek and Raviv in 1974 [1]. This algorithm is a trellis-based 
decoding algorithm for both block and terminated convolutional codes. It is devised to minimize 
the symbol error probability. Unfortunately, the implementation of this algorithm requires large 
computation and storage. Furthermore, its forward and backward recursions result in long 
decoding delay. As a result, the potential of the MAP algorithm has not been studied until 
most recently when this algorithm was used in turbo (or iterative) decoding to achieve an error 
performance near the Shannon limit [2]. In the study of turbo decoding, a focal point is the 
MAP algorithm which is actually the heart of turbo decoding. The concern is how to simplify 
this decoding algorithm and reduce both the decoding complexity and delay. 

This paper investigates decoding complexity and delay of the MAP algorithm and its vari- 
ations, such as Log-MAP [3] and Max-Log-MAP [4] algorithms, for linear block codes. For 
decoding linear block codes, conventional MAP and Max-Log-MAP algorithms have been de- 
vised based on bit-level code trellises [1, 4]. In this paper, it is shown that these decoding 
algorithms can be modified and carried out based on sectionalized code trellises. Proper sec- 
tionalization of a code trellis results in a significant reduction of decoding computational com- 
plexity. Computation-wise optimum sectionalizations of a code trellis for MAP, Log-MAP and 
Max-Log-MAP algorithms are investigated. Also investigated in this paper are bi-directional 
and parallel MAP decodings based on the structural properties of code trellises. Bi-directional 
decoding can reduce the decoding delay by a factor close to two. Parallel decoding not only 
simplifies decoding complexity but also speeds up the decoding process. 

The organization of this paper is as follows. Section 2 gives a brief review of sectionalized 
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trellises for linear block codes. In Section 3, a modified MAP algorithm based on a sectionalized 
code trellis is first described and its computational complexity and storage requirement are ana- 
lyzed. Then optimum sectionalization of a code trellis to minimize the computational complexity 
is considered. Modified Max-Log-MAP and Log-MAP algorithms based on a sectionalized code 
trellis and their computational complexities are presented in Section 4. Bi-directional and par- 
allel MAP and Max-log-MAP algorithms are described in Section 5. Section 6 summarizes the 
results and concludes the paper. 


2 A Brief Review of Sectionalized Trellises 

Consider an (n, k) linear block code C with a minimal n-section bit-level trellis T in which each 
branch represents a single code bit [5, 6]. For any positive integer v such that 1 < ^ < n, 
the bit-level trellis T can be sectionalized into v sections with section boundary locations in 
U = {h 0 , hi, • • • , h u ) where 0 = h 0 < hi < • • • < h„ = n. This sectionalization results in an 
i/-section trellis T(JJ). At boundary location hj, the state space (the set of states) is denoted 
E^(C). The j-th section of T(U), denoted Tj, consists of the state space E^_,(C) at time- 
hj_ i, the state space E h,(C) at time-hj and the branches that connect the states in E h,-i(C) 
and the states in E^C). A branch in this section represents rrij = hj — hj_i code bits. Two 
adjacent states a' and a with o' G E h 3 ^{C) an< ^ & £ E hj (C) may be connected by multiple 
branches, called parallel branches. For convenience, we say that these parallel branches form a 
composite branch, denoted L(cr' , cr). Each branch b(<r',<j) G L((j',a) is labeled by a mj-tuple 
(«/,,_,+ i,v h] _ i+ 2 , •••,%), where v hj _ 1+i = ±1 for BPSK signaling with unit energy. 

A codeword in C is denoted by v = (vj, v 2 , • • ■ ,u n ). Let Ch } _ u hj denote the linear subcode of 
C which consists of those codewords in C whose components are all zero except for the hj — /ij_i 
components from the (hj - 1 + l)-th bit position to the hj- th bit position. Let be the 

punctured code of length hj — hj - 1 obtained from C by removing the first hj - 1 and last n — hj 
components from each codeword in C . For a linear code A, let k(A ) denotes its dimension. 
Then the number of states at time-hj in T(U ) is given by [5]: 

lE/^C)! _ 2 k ^ C l~ k(C °’ h 1 ' ) ~ k(Ch r n) . (1) 

The number of composite branches converging into (or entering) a state G E^(C) at 
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tim e-hj, called the incoming degree of cr^, is given by 


degK) in £ (2) 

The number of composite branches diverging from (or leaving) a state o G (C) at 

time-/ij_i, called the outgoing degree of a h) _ n is given by 

degK^Jout = 2 fe(C ^-»' n) “ fe(Ch >- n) " fc(C ^- 1 ^ ) . (3) 

The branch complexity of the trellis section Tj is measured by: (1) the size of a composite 
branch, denote (2) the number of distinct composite branches in the trellis section, denoted 
\Bj\] (3) the total number of composite branches in the trellis section, denoted \Bj\. These 
branch complexity parameters are given below [5]: 

\Bj\ = 2 fc(c V>^ ) , 

\Bj\ = 2 k< ' Ph >-'’ h ^ c)) ~ k{Ch )- 1 ' ,, >\ (4) 

\Bj\ = |E fc ,(C)| • deg(^) in = 

In the trellis section Tj, each distinct composite branch appears 

2 /:(C)-fc(C 0 , hj _ 1 )-fc(C hj , n )-*:(p hj _ 1 ,h J (C)) 

times. In general, \B^\ is much larger than \Bf\. This fact will be used in reducing the compu- 
tational complexity of MAP algorithms. 


3 A Modified MAP Algorithm Based on a Sectionalized 
Trellis 

For decoding block codes, the conventional MAP algorithm has been devised based on bit-level 
trellises [1][4]. In this section, we show that the MAP algorithm can be carried out in two stages 
based on sectionalized trellises. Proper trellis sectionalization results in a significant reduction 
in storage requirement and computational complexity. 
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3.1 The algorithm 


Consider an i/-section trellis T(U) for an (n, k) linear block code C with section boundary 
locations in U = {ho, hi, • • • , h„}. Let L(a',a) be a composite branch in the jr -th section Tj 
of T(U ) which connects state a' to state cr with cr' G and a G £^(( 7 ). Each branch 

b(a', cr) G consists of m ; = hj — hj-\ code bits, denoted 

= Ky_j+1, V hj _ 1+ 2, ••■,V h} ). 

Let r = (r x ,r 2 , • • • ,r„) be the received sequence and r, = (r^_ 1+x , r hj _ l+2 , • • • , r hj ) denote 
the j-th section of r. For each branch b(<7',cr) G L(a',a), define the following probability: 

lb, (b(</, cr)) = p((7,b(«7 , ,cr),r i |<r') 

= p(o-,b(o- , ,cr)|<7 , )p(r i |(<T , ,<7),b(CT , ,<r)). (5) 

The value 7^ (b(cr', cr)) represents the transition probability from state a' to state a through 
the branch b(<r', cr) that produces Tj. For simplicity, we call it branch (transition) probability. 
Then the probability of the composite branch L(a',cr) connecting state a' to state cr that results 
in the received vector Tj is given by 

lh,(L{a',a)) = 7A J (b(cr , ,a)). (6) 

b(t7 / ,<r)€£(<7 / >0') 

For the MAP algorithm based on the sectionalized trellis T(U), the forward and backward 
recursions are to compute the following state probabilities: 

a^(cr) = Yj 7/ij <T )) a /i J -i { a ')i ( 7 ) 

Phj- 1 (o ,/ )= D lh i (L{o f ,a))P hj (<r), (8) 

<r€Oh J (<r') 

where n^_,(cT) denotes the set of states in that are adjacent to state cr and 0^ (cr') 

denotes the set of states in £^(C) that are adjacent to state cr'. The forward and backward 

recursions are initialized with co, 0 (<7o) = 1 and 0h v { a f) — 1, where cr 0 and cr j are the initial state 
and final state of the trellis T(U ) at time-0 and time-n, respectively. 

For computing the log-likelihood ratio (LLR) of the code bit vi, /i y— 1 + 1 < / < hj, define 

7 h,(L+{<T',a))= 7fc J (b(cr',cr)), (9) 

b(cr / ,(7)GL(a / ,<7) 

Vf=+1 
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7 *,(W*)) = 


( 10 ) 


X) 7^(b(<T',<T)). 

b (a* t o)€L(a f ,o) 

vi-~l 

It follows from the definitions of (6), (9) and (10) that 


~t h} {L{cr',a)) = 7 h } (L+( 


v',?)) + lh J {L Vl {(r’,<T)), 


(11) 


for every code bit vi in Tj. Then the LLR of vi is given by 


L(vi) = log 


where the summations are over 

^s Aj (C). 


£(„v) (*»)&» 

*=± 1 , ( 12 ) 

£ (<,» a*;-, (v')lh } ( L VI (cr', a))/3 hj (a) 

V( = -l 

all the adjacent state pairs (a', a) with a' G S/ lj _ 1 (C) and 


To carry out the decoding process, we must first compute the composite branch probabilities, 
j h] (L(a',a)ys. In a sectionalized trellis, a section may consists of many composite branches, 
however, the number of distinct composite branches is relatively small. In computing a’s, /?’s 
and LLR’s, we only need to compute the probabilities of the distinct composite branches. Based 
on this fact, we may perform a preprocessing step to compute 7* } (L(&',o’)), 7 and 
7/ l> (Z^(<r', a)) for each distinct composite branch L(cr',(T ) and each code bit vi and store them 
in a table called the 7^ -table. This preprocessing step reduces computational complexity of the 
MAP algorithm significantly. 


The MAP algorithm based on a sectionalized trellis T(U) can be carried out in two stages. 
At the first stage, the parallel branches of each distinct composite branch are preprocessed to 
form the 7-tables. Then, the MAP decoding is performed with parallel branches in a composite 
branch viewed as a single branch. 

Consider the computation of a branch transition probability ^ h} {h{a' , a)) given by (5). For 
equally likely signaling and a linear code, all the states at any section boundary are equiprobable. 
Then 


p(t7,b(<7',cr)|cr') 


i> efV (,') i^Kor 


(13) 


As |ft A ,(<T , )| and \L(a', cr")\ remain the same for all states a 1 G S^_,(C) [5], p(a,b(a' ,a)\cr') is 
constant in the trellis section Tj. Since we are only interested in the ratio given by (12), we can 


5 



scale the branch transition probability 7/ Vj (b(cr', <7)) by any factor without changing the LLR of 
an estimated code bit. Therefore, in computing 0^(0-), (3^-^cr') and L(vi), we can use 

w^(b(cr',(r)) = p( Tj\(cr',a),b(a',a)) (14) 

instead of 7^ (b(cr', <7)) to simplify computations. For an AWGN channel with zero mean and 
variance No/2, 

/ 1 \ mj/2 

Wh} (b(a\a)) =(-—-) exp{— £ (r, - ®,) 2 /JV 0 }. (15) 

\*N 0 J i =hj _ l+ 1 

To construct the 7-tables for the z/-section trellis T(U), we use the following procedure: 

For 1 < j < v. 


(1) Compute w/ lj (b(<7 , ,<7)) using (15) for all distinct branches in trellis section Tj. 

(2) Compute 7/ lj (I+(<7',cr)) for each code bit v\ for hj- 1 + 1 < l < hj. 

(3) Compute 7 hj{L~ h +i (<7',<r)) for the code bit v h] _ 1+ i. Then, it follows from from (11) that 

= 7*>(^_ 1+1 (^. ff )) + 7^(^i i _ 1+1 (^.^))- 

(4) Finally, using (11), we obtain j h} {L~(cr', a)) for /tj_i + 2 < / < hj, by computing the 
difference, 7^ {L(a', a)) - 7/ 1 j (L+(ct',< 7)). 


From (7), we see that a^(<7)’s can be computed along with the construction of 7-tables from 
the initial state a 0 to the final state oj of the code trellis in forward direction. If bi-directional 
decoding (see Section 5) is performed, it follows from (8) that (<r')’ s can be computed 
along with the construction of 7-tables from the final state o j to the initial state <r 0 of the code 
trellis in backward direction. As soon as (cr')’s and yd/i J _ 1 (<r) , s at the boundaries of the j-th 
trellis section Tj have been computed, the LLR’s of the code bits Vi with hj- \ + 1 < / < hj are 
evaluated from (12). 


3.2 Computational complexity and storage requirement 

The computational complexity of the MAP algorithm is measured in terms of the number of 
real operations required to decode a received sequence. It can be analyzed by enumerating 
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the numbers of real operations required for constructing the 7-tables and computing a’s, 0’s 
and LLR’s of the estimated code bits. We assume that computations of exp(-) and log(-) are 
accomplished by using a read-only memory (ROM) (i.e., table look-up). 

To construct the 7 hj -table for the j-th trellis section T, based on the procedure presented in 
the previous subsection, the computations required at each step are given below: 

(1) step-1 requires \Bj\ • \B?\ • mj additions and \Bj \ • \B?\ • (rrij — 1) multiplications. 

(2) step-2 to step-4 require \Bf\ • (|Bj|/2 - 1) • mj, \B}\-(\B*\/2-l) + l and mj - 1 additions, 
respectively. 

Therefore, construction of 7^ -table for the trellis section T } requires a total of 

N’{ 7) = \B}\ ■ \Bj\ • mj + \Bj\ ■ (|Rj|/2 - 1) • mj + \B*\ • (|Rj|/2 - 1) + mj (16) 

additions and a total of 

NLh) = |B/I ' \B'\ ■ (mi - 1) (17) 

multiplications. 

Computations of a’s and 0’s from (7) and (8) require a total of N’{a) + N 3 a (p) additions 


and N^(a) + multiplications, where 

N>(a) = (degK) to -l)-|S 4i (C)| = |B'|-|S/.,(C)|, (18) 

Ni{0) = {deg(a hl _,) ou t - 1) • |£/ 1 ,_ 1 (C)I = - |Sa,_,(C)|, (19) 

«£(«) = Niifi) = |BJ|. (20) 

The last step of MAP decoding is to compute the LLR’s of the estimated code bits vi for 
hj-i + 1 <l<hj with 1 < j < v. Define 

5«> = E (21) 

S$(v,) = E akj-Ao'huVi (*»)&». (22) 

(cr',<r) 

v { =4-l 

s!3m = E (<’ , K(£;, ("»)&»■ . (23) 

V| = -l 
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It follows from (11) and (21) to (23) that 


S U) = S^(v t ) + (24) 

for i + 1 < / < hj. To compute the LLR L(u/)’s from (12), we need to compute S+i(u/)’s and 
S_l(vi)'s. Computations of S+i(uj)’s and S_i(uj)’s can be done efficiently by using the following 
procedure: 

(1) Compute from (21), which requires \Bj\ — 1 additions and 2\Bj\ multiplications. 

(2) Compute S+i(uf)’ s from (22) for /ij_i + 1 < / < hj, which requires {\B c -\ — 1) • mj additions 
and \Bj\ ■ mj multiplications (using partial results from step-1). 

(3) Compute 5ifi(t>j)’s from (24) by taking the differences, — <S+i(w/), for /ij_ i + l < / < hj. 
This step requires rrij subtractions ( equivalent to additions). 

Once S+l(viYs and S£j(uj)’s have been computed, the LLR’s of estimated code bits vi for 
hj-i + 1 < l < hj can be evaluated, which requires rrij divisions (a division operation is assumed 
to have the same complexity as a multiplication operation). Therefore, computation of the 
LLR’s of estimated code bits corresponding to the trellis section Tj requires a total of 

Wi(i) = |B;|-l + |BJ|-m j (25) 

additions and a total of 

Ni(L) = 2|B|| + (|BJ| + 1) ■ m, (26) 

multiplications (including rrij divisions). 

Summarizing the above results, execution of the MAP algorithm based on the sectionalized 
trellis T(U) requires a total of 

N a (U) = 7 ) + Nl(L)) + £ Ni(a) + E N’(0) (27) 

i=o j=i j=o 

additions and a total of 

N m (U) = E(JVi(i) + NHL)) + g I Vi(or) + g N’Jfi) (28) 

j=0 j= 1 j = 0 
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multiplications. The numbers N a (U) and N m (U) together give a measure of computational 
complexity of the MAP algorithm based on the sectionalized trellis T(U). 

During the decoding process, the 7-tables must be stored for the computations of a's , 0's 
and LLR’s of the estimated code bits. This requires 

M( 7 ) = £ \Bf\ ■ (2m, + 1) (29) 

j—0 

storage locations (or unites). If bi-directional decoding is performed, we also need to store 
a’s and 0's for the computations of LLR’s of the estimated code bits before the forward and 
backward recursions meet at the middle of the trellis. This requires ^ ^ storage locations, 
where 

M(a) = 2|Ei,(C)|, (30) 

J = 1 

WW = E|S/ l ,.,(C)|. (31) 

j=0 

If the LLR’s of estimated code bits are to be used for further decoding process, they must be 
also stored. This requires another 

M(L) = n (32) 

storage locations. Therefore, the total storage requirement for MAP decoding based on section- 
alized trellis T(U) is 

M(U ) = M(7) + M(Q) j M( ~ + M(L). (33) 

3.3 Optimum sectionalizations 

A code trellis can be sectionalized in many ways. Sectionalizations that give the smallest number 
of computation operations and memory storages are called computation- wise optimum section- 
alizations and memory-wise optimum sectionalizations, respectively. An algorithm for finding 
computation-wise optimal sectionalizations for Viterbi decoding of block codes has been devised 
by Lafourcade and Vardy [7]. This algorithm can be applied to MAP algorithms. 

The Lafourcade and Vardy algorithm is based on the following simple structure: For any 
two integers x and y with 0 < x < y < n, a section from time- a: to tim e-y in any sectionalized 
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trellis T(U ) with x,y € U and x + l,x + 2, •••,$/ — 1 £ U is identical [5]. Let c£>(x,y) denote 
the number of computations (or storage unites) required to compute 7 ? s, cc’s, /?’ s and LLR’s of 
the MAP algorithm to process the trellis section from time-x to time-y. This number ip(x,y) 
is solely determined by the choices of x and y. Let 9 m in( x ’^) denote the smallest number of 
computations (or storage unites) required in MAP decoding to process the trellis section(s) from 
time-x to time-y in any sectionalized trellis T(U) with x, y 6 U. The value 9 m in(0’ n ) gi yes the 
smallest total number of computations (or storage unites) of the MAP algorithm for processing 
the code trellis with an optimum sectionalization. It follows from the definitions of <p(x,y) and 

9min( x ’ y) that 


y) ” i 


min{</?(0, y), min o<a; <y{v? m in(0, x) + y?(x, y)}}, 

9 ( 0 , 1 ), 


for 1 < y < n 
for y = 1. 


(34) 


For every y € {1,2, •••,«}, ^min^y) can be computed as follows. The values of ip(x,y) for 
0 < x < y < n are computed using the structure of the trellis section from time-x to time-y. 
First, (^min(0, x) is computed. The value v?min(0, y) can be computed from y?min(0, x) and <^(x, y) 
with 0 < x < y using (34). By storing the information when the minimum value occurs in the 
right-hand side of (34), an optimum sectionalization is found from the computation of </>min(0, n). 


The computational complexity and storage requirement of MAP decoding of a linear block 
code very much depend on the sectionalization of the code trellis. A sectionalization that mini- 
mizes both is desirable. However, such a sectionalization in general does not exist. If there is no 
severe constraint on the size of memory storage, we may choose a sectionalization that minimizes 
the computational complexity. Based on the above analysis, decoding computation of the MAP 
algorithm involves two kinds of real number operations, additions and multiplications, in every 
decoding step. A multiplication operation is more complex than an addition operation and they 
can not be treated the same (to have the same weight) in the minimization of computational 
complexity. This makes it hard (if not impossible) to find a sectionalization that minimizes both 
the number of additions and the number of multiplications. Since the number of multiplications 
required in the MAP decoding is much larger than the number of additions required and a 
multiplication operation is much more complex than an addition operation, we may just find 
a trellis sectionalization to minimize the total number of multiplications. Alternatively we can 
weight an addition operation as a fraction of a multiplication operations, say 1/20 of a multipli- 
cation. Then we find a trellis sectionalization to minimize the total number of multiplications 
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and weighted additions. Optimum trellis sectionalizations (in terms of minimizing the number 
of multiplication operations) of some RM codes for MAP decoding are given in Table 1. For 
comparison purpose, the computational complexity and storage requirement based on the bit- 
level trellis for each code are also included. From this table, we see that bit-level trellis requires 
much larger computational complexity and storage requirement than an optimum sectionalized 
trellis. We also see that the optimum trellis sectionalization in terms of minimizing the number 
of multiplication operations may not reduce the number of addition operations. So there is a 
trade-off between numbers of additions and multiplications. 

From Table 1, we see that optimum sectionalization is more efficient for low-rate codes than 
for high-rate codes. This is because that \Bf \ tends to be large in high-rate codes [5]. 

From Table 1, we also see that optimum sectionalization of a code trellis, in general, results in 
a non-uniform sectionalized trellis (trellis sections are not equal in length). For IC implementa- 
tion of a MAP decoder, since using the same hardware to process all the trellis sections is highly 
desirable, a uniformly sectionalized trellis seems a better choice. Table 2 gives the best uniform 
sectionalizations for RM codes with the MAP decoding. Uniform sectionalizations marked with 
are also optimal sectionalizations. From Tables 1 and 2, we observe that the best uniform 
sectionalization only requires slightly more operations than the optimum sectionalization. 


4 The Max-Log-MAP Algorithm Based on Sectional- 
ized Trellises 

The Max-Log-MAP algorithm is a suboptimum version of the MAP algorithm [3, 4]. It provides 
an efficient trade-off between error performance and decoding complexity. This algorithm is 
based on a very simple approximation for logarithm of a sum of real numbers. For a finite set 
of real numbers, {6 X , • ■ • , <5,}, the following approximation holds: 

logd> 5 ') ^ (max {$;}). ( 35 ) 

,=i 

This approximation is called maximum logarithm (max-log) approximation. 
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4.1 The algorithm 


Using the max-log approximation, the LLR of an estimated code bit given by (12) based on a 
sectionalized code trellis T(U) can be can be approximated by 


L(vi) = max {log (cr') + log7/, ; (L^crV)) + log ^ (<t)} - 

(cr',<r) 

V| = + l 

max {log (a') + log7/ lj (L”(<7 , ,<T))-t-log^(<r)}, (36) 

(o', a) 
vi = -\ 

for hj- 1 + 1 <1 <hj. It follows from (6) to (10) and the max-log approximation of (35) that 
the state and composite branch metrics in (36) are given below: 


log othj (o - ) = , max ,{l°g7^(^'( cr * <T )) + l°g a fc J -_i(°‘ , )}> 
log/^j-iC* 7 ') = max {log 7 ^ {L(a, cr)) -f log fl hj (<r)}, 

log lh,(L(a',a))= max {log7fc.(b(®V))}, 

b(a ,i 7)€L\<j ,<t) 

l°g7 h,(L+(<r',<T))= max {log 7 fcy (b(a', cr))}, 

b (<?' ,<?)£L(a 
«i=+l 

l°g7 K } {L~{cr',a))= max {log7 fcj -(b(<7 , ,<r))}, 

b (a \a)€L(<7 ,<r) 
v/ = -l 


(37) 

(38) 

(39) 

(40) 

(41) 


for hj-i + 1 < l < hj. 

The metrics, log cth, (cr) and log /?*. (cr), are simply the forward and backward metrics of state 
cr, respectively, and they can be computed recursively with initial conditions, log or/^, (cr 0 ) = 0 
and log ^ (cry) = 0. The metric \og^h.,{L(a' ^a)) is simply the metric of the composite branch 
L(er\cr). The sum 

log o^-i C* 7 ') + log7/i J (£(<7 , > cr )) + log 0hj(<r) 

evaluated from (37) to (39) represents the metric of a path in T(U) that passes through state 
a' at time-/iy_i, state cr at tim e-hj and a branch in L(cr\cr). 

For the AWGN with BPSK transmission, we use (15) to compute log 7^ (b(cr', cr)). Since No 
and (^•) m •’ /,2 are constants in 7), we can use 

hj 

log 7 fy(b(a',<r)) = £ r l v h ( 42 ) 

+1 
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as the metric of branch b(cr',<7) in computing log 7 / lj (L(cr , ,cr)) , s. 

Similar to the MAP algorithm based on a sectionalized trellis T(U), the Max-Log-MAP 
algorithm can also be carried out in two stages. At first stage, the parallel branches of each 
distinct composite branch L(a',a) are preprocessed to obtain the composite branch metric 
log 7 hj {L((r',cr)) and the bit metrics, log 7 fcj (L+(er',<r)) and log 7 hj {L~{a\a)) for /ij-i + 1 <l< 
hj. These metrics are stored in a table, called the branch metric table for the trellis section Tj 
from time-hj-i to tim e-hj. Let b*(cr',< 7 ) = (v* h ._ l+1 ,v* hj _ l+2 , - ■ ■ ,v m hj ) be the branch that has the 
largest branch metric among parallel branches in L(er',cr). From (39), we have 

log 7 (L(a', <r)) = log 7 (b*(cr', a)). (43) 

It follows from (39) to (41) and (43) that 

log 7 ^(Z/(cr , ) < 7 )) = max{log7^(L+(cr , ,<7)),log7/ lj (L"(t7 / ,o-))} (44) 

| log 7 *,-(£+(*', *)), if w,- = 1 , (45) 

\ log7/». j{L-{<r',a)), if v? = -1, 

for hj- 1 + 1 < / < hj. Based on (45), we can construct the branch metric table for the trellis 
section Tj using the following procedure A: 

(1) Compute log 7 /,, (!/(</, < 7 )) from (39) for each distinct composite branch in Tj. 

(2) For each code bit vi in Tj, based on b*(<7 / , < 7 ) and from (45), we first check whether 
v* = 1 or — 1 (a logic operation) to determine which one between log 7 ^( 1 -+ (< 7 ', < 7 )) and 
\og^ hj (L-(a',a)) is equal to log 7 h} (L(a',a)). Then we only need to compute the one 
between log 7 /i J (L^(cr', a)) and log 7 ^ (L“ (< 7 ', < 7 )) that is not equal to log7/i J (L(<7 , ,<7)). 

At the second stage of the Max-Log-MAP decoding, the state metrics log a h] ( cr ) and log 0 hj _ t (a 1 ) 
are computed from (37) and (38) recursively with initial conditions, log q;/j 0 (<7o) = 0, and 
log /3h u (< 7 y) = 0. Assuming bi-directional decoding, logo^tr) and log /?/,,_! (‘T 7 ) are computed si- 
multaneously from both directions of the trellis T(U) along with the construction of the branch 
metric tables, section by section in serial manner. Once the state metrics, log (<7 r ) and 
log /^(er), at the section boundary locations hj- 1 and hj, have been computed and the branch 
metric table for trellis section Tj has been constructed, the LLR’s of the estimated code bits v/ 
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for hj- 1 + 1 < / < hj can be computed from (36) by executing the add-compare-select-subtract 
(ACSS) process (similar to the Viterbi algorithm). 


To compute the LLR L(t>i ) efficiently, define 

R (j) = max{loga fc> _, (a 1 ) + log 7 ^ (£(</, a)) + log yS A> (a)}, (46) 

(<7 ,<7) 

#+i(i>i) = max {log a hj _j (cr') + lo g7/ lj (^ ( ( <7, 7 cr )) + 1 °g^,(°')}> ( 47 ) 

(<7', <r) 
vi=+i 

i*!f|(t>/) = max {log a*,., (a) -Hog 7 ^ (T+ (crV)) -Mog /?,,,( cr)}}, (48) 

(<7',<7) 

V|=-l 

for 1 < j < v. From (11), (46) to (48) and using the max-log approximation, we readily see 
that for hj- \ + 1 < / < hj, 

RW = ma xiR^iv,), v,)}. (49) 

It follows from (45) to (48) that 

«0, = { R » M ’ = (50) 

i?^x(u/), if vf = -!• 


Then an efficient procedure for computing f?+i(u/), f?ff](u/) and L(vi), called procedure B, is 
given below: 

(1) Compute based on (46). 

(2) For each code bit v\ in Tj, based on b*(cr', a) and from (50), we first check whether vf = 1 
or —1 to determine which one between R+\(vi) and f2^](v/) is equal to R^\ Then, compute 
the one between f?+](v/) and f?[fj(u/) that is not equal to 

(3) Compute L(vi ) by taking the difference, i?+](uj) — Rff](u/), for hj - 1 + 1 < l < hj. 

4.2 Computational complexity and storage requirement 

The computational complexity for constructing the branch metric tables for the trellis sections 
can be analyzed based on procedure A. From (39) and (42), we find that step-1 of procedure A 
requires \Bf\ • \Bj \ • ( m.j — 1) additions and \Bj\ • ( |BJ| — 1) comparisons to compute the branch 
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metrics for all the distinct composite branches in the trellis section Tj. From (45), (40) and (41), 
we find that step-2 of procedure A requires logic operations and \Bj\-(\Bj\/2— comparisons 
to compute metrics, \og~f hj (L+(<r',cr)) and log7/ lj (L^(<7 , ,cr)). Therefore, construction of the 
branch metric table for the trellis section Tj requires a total of 

N>(-l) = \Bj \ ■ (|B?| - 1 + (IBJI/2 - 1| • my) (51) 

comparisons and a total of 

Nlh) = \Bf\ ■ \Bj\ ■ (my - 1) (52) 


additions. 

From (37) and (38), we find that the computation of metrics of states at the boundaries of 
Tj requires a total of N 3 a {a ) -f NZ(p) additions and N 3 (a) + N 3 (/?) comparisons, where 


N’ e ( a ) = \Bj\ - |£ k ,(C)|, 

(53) 

JV'(/?)=|B;|-|E k ,_,(C)l, 

(54) 

Ni(a ) = N’W = |BJ|. 

(55) 


To analyze the complexity of computing the LLR’s given by (36), we follow procedure B. 
Based on (46), step-1 requires 2|J3J| additions and \B C j\ - 1 comparisons to compute R (j) ’s in 
the trellis section Tj. Based on (50), (47) and (48), step (2) requires logic operations, \B C : \ • rrij 
additions and (|£??| — 1) • rrij comparisons to compute 72+i(u/)’s and i^_f](u/)’s. Step-3 requires 
mj subtractions (a subtraction operation is assumed to be equivalent to an addition) to compute 
LLR’s in the trellis section Tj. Therefore, a total of 

N’(L) = (|B|| - 1) • (my + 1) (56) 

comparisons and a total of 

N 3 a (L) = {2 + m ] )-\B c : \+m J (57) 

additions (including subtractions) are required to compute LLR’s in the trellis section Tj. 

Since a comparison operation has the same complexity as an addition, it is regarded as 
an addition-equivalent operation. Therefore, to decode a received sequence, the Max-log-MAP 
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algorithm based on the sectionalized trellis T(U) requires a total of 


V— 1 


IS-l 


u—2 


N ae (U) = 7) + N’( 7) + N’{L) + Nli'L)) + £(JV'(a) + N’(a)) + £(^(0) + JV'(/3)) 

j=° j=l j = 0 


( 58 ) 


addition-equivalent operations. N ae (U) is used as a measure of the computational complexity 
of the Max-log-MAP decoding algorithm based on a sectionalized trellis T{U). 

The storage requirement for the Max-log-MAP algorithm is the same as that for the MAP 
algorithm. 

Table 3 gives optimum sectionalizations (in terms of minimizing the number of addition- 
equivalent operations) of trellises for some RM codes with the Max-Log-MAP decoding. For 
comparison purpose, the computational complexities and storage requirements of these codes 
based on bit-level trellises are also included. We see that proper sectionalization reduces com- 
putational complexity and storage requirement significantly for the Max-Log-MAP algorithm. 


4.3 Log-MAP algorithm 

The Max-Log-MAP algorithm is a suboptimum realization of the MAP algorithm. Even through 
it gives an error performance very close to that of the MAP algorithm as shown in Figure 1, it 
produces soft-output values inferior to that of the MAP algorithm, due to the approximation 
of (35). Hence, when we use the Max-Log-MAP algorithm in turbo decoding, the inferior relia- 
bility value (the soft-output of the Max-Log-MAP decoder) results in performance degradation 
compared with the optimum MAP decoder. Figure 2 shows bit error performances of turbo 
decoding of the parallel concatenated code with block interleaver of size 256 and the (32,16) RM 
component codes. We see that at bit error rate of 10 -3 , the Max-Log-MAP decoder results in 
0.2 to 0.4 dB performance degradation compared with the MAP decoder. 

To overcome this problem, the Jacobian logarithm 

log(e 5 ‘ + e 6i ) = max{^,(5 2 } + log(l + e -1 * 2-5 ' 1 ) = max{6i,6 2 } + / c ( \8 2 - £i|) (59) 

can be used, where / c (-) is a correction function [3]. Then, for a finite set of real numbers, 
log(e*' + ••• + e^) can be computed recursively. The recursion is initialized with 
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two terms given by (59). Suppose that log(e 51 + • • • + e 5 - 1 ) with 1 < i < q is known. Hence, 


log(e fl + --- + e 6 ') = log(A + e Si ) 

= max{log A, 6,} +/ c (|logA — «5,|), (60) 

with A = e Sl + • • • + e 5,-1 . Based on this recursion, we modify the Max-log-MAP algorithm 
through the use of simple correction functions. This algorithm, called the Log-MAP algorithm 
[3], gives the same error performance as the MAP algorithm, but is easier to implement. Each 
correction term needs an additional one-dimensional look-up table, and two additions based 
on (59). Consequently, the Log-MAP algorithm requires only additions and comparisons for 
computing the LLR’s. 

The storage requirement for the Log-MAP algorithm is the same as those for the MAP and 
Max-log-MAP algorithms, assuming the storage of the look-up tables is negligible. 

Consider the computational complexity of the Log-MAP algorithm. Since two extra additions 
are required per comparison to calculate /<,(•) in (59), a total of iV^'('y) T 3-/V^('y), iV a (o;) T 
3ATJ(a), Nj>(l3)+3N ] a {t3) and A^'(T)+3iV c J (L) addition-equivalent operations required to compute 
log7’s, logo’s, logo’s and LLR’s in Tj, respectively, where N> a ()’s and N> ()’s are the numbers 
of additions and comparisons evaluated for the Max-Log-MAP algorithm in Section 4.2. 

Table 4 gives optimum sectionalizations (in terms of minimizing the number of addition- 
equivalent operations) of trellises for some RM codes with the Log-MAP decoding. For com- 
parison purpose, the computational complexities and storage requirements of these codes based 
on bit-level trellises are also included. We also see that proper sectionalization reduces compu- 
tational complexity and storage requirement for the Log-MAP algorithm. 


5 Bi-directional and Parallel MAP Decoding 

To reduce the decoding delay and speed up the decoding process of the MAP algorithm, a 
bi-directional MAP algorithm can be devised. This bi-directional MAP algorithm allows to 
compute the forward and backward recursions simultaneously. 

To achieve bi-directional decoding, we can permute the encoded sequence (iq, v 2 , ■ • • , v n ) to 
(vi,v n , W 2 > u n-i 5 •••) before transmission. Let r = (rx,r n ,r 2 ,r n _i,- • •) be its corresponding re- 
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ceived sequence. Based on the interleaved received sequence r, we compute the 7 probabilities at 
the boundary locations in the following order: 7/,, — ► 7^ — * 7^ — ► 7^ l/ _, —►•••. A permutation 
circuit permutes the received sequence r into 17 = (17,77, • • • , r„) and r 2 = (r n , r„_i, • • • ,77) and 
shift them from both ends of the sectionalized trellis T(U) to perform forward and backward 
recursions simultaneously and compute the a and 0 probabilities along with computation of j's 
in both directions. When the recursions meet at the middle of the trellis, the computation of 
the log-likelihood ratios of the code bits begins based on (12). 

Even though the same number of computations is required, this approach roughly doubles 
the decoding speed (or reduces the decoding time by half). If the code trellis has mirror image 
symmetry [ 5 ], we use two identical circuits to compute a and 0 . This also simplifies the IC 
implementation. Trellises for RM codes and all cyclic codes have mirror symmetry [ 5 ]. This 
bi-directional decoding approach can also be applied to the Log-MAP and Max-Log-MAP algo- 
rithms. 

An i/-section trellis for a linear block code can be decomposed into parallel and structurally 
identical subtrellises without cross connections among them [ 5 ]. Each subtrellis has much smaller 
state complexity and connectivity than the full code trellis. This parallel decomposition allows 
us to devise identical smaller MAP (or Max-Log-MAP) decoders to process all the subtrellises 
in parallel independently without communication between them. This also simplifies the IC 
implementation and speeds up the decoding process [8]. 

Suppose an i/-section trellis for an ( n , k ) linear block code is decomposed into Q subtrellises, 
T(1),T(2), • • • ,T(Q). The MAP decoder for the subtrellis T(q), 1 < q < Q, finds a pair of 
values, G+^u;) and G q _ l (vi) for each code bit u, in j-th section with 0 < i < n, as follows, 

Gil(»i)= £ (61) 

(o',a)dT( q ) 

v» = ±l 

Then we determine the final pair of values of the entire trellis, denoted (G+i(t>,-), G_i(u,)) as 
follows, 

G +1 ( Vi )= £ Gt. 1 (u,) and G_i(u,) = £ GI,(t;,). (62) 

1<,<Q 1 <q<Q 

Finally, the log-likelihood ratio of t>, is given by 

£ <*>= l0 sirfef (63) 
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Similarly, the Max-log-MAP decoding can also be performed in parallel. The Max-log-MAP 
decoder for T(q) obtains a pair of surviving metrics, M^. 1 (ui) and M2 1 (vi), for u, which are given 

by 

M±i{vi) = max {log a/ l> _ 1 (a') + log (^ , , cr )) + log/J/^cr)}. (b4) 

(a',a)eT(q) 

V»=± 1 

Then the final surviving pair of the entire trellis, (M+i(v,), are given by 

M+i(vi ) = max{M^. 1 (ui) : 1 < q < Q} and M_i(v;) = max{Ml 1 (i>i) : 1 < 9 < Q }• (65) 

Finally, the log-likelihood ratio of u; is given by the difference, M+i(vi) - 

From the stand-point of speed, the effective computational complexity of decoding a received 
sequence is defined as the computational complexity of a single parallel subtrellis plus the cost of 
the final summations (or comparisons) among the survivors generated by each of the subtrellis 
decoders. The time required for final summation (or comparison) is generally small relative to 
the time required for processing a subtrellis. Furthermore, since all the subtrellises are processed 
in parallel, the speed of decoding is therefore limited only by the time required to process one 
subtrellis. Consequently, this approach not only simplifies the decoding complexity but also gains 
speed. For example, the 4-section trellis diagram of the (32,16) RM code is shown in Figure 3. 
It consists of 8 parallel and structurally identical subtrellises without communication between 
them. From Table 5, we observe that a single subtrellis has much less computational complexity 
than the entire trellis with the Max-log-MAP decoding. The system level architecture utilizes 
8 low complexity Max-Log-MAP decoders to decode 8 subtrellises in parallel. Furthermore, the 
parallel subdecoders are identical, so that the IC implementation is easy. Also it is clear that 
both bi-directional and parallel decoding processes can be incorporated in a single decoder. 


6 Conclusion 

In this paper, we have modified the MAP, Log-MAP and Max-Log-MAP algorithms for decoding 
linear block codes based on sectionalized trellises in order to reduce both the decoding complexity 
and delay. Example results show that properly sectionalized trellises require less real operations 
and less memory than the bit level trellis. Furthermore, we have taken advantage of the trellis 
structure of linear block codes, such as mirror image symmetry and parallel structure to perform 
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bi-directional and parallel decodings. The bi-directional decoding is a simple approach to reduce 
the decoding delay by a factor close to two. The parallel decoding uses identical subdecoders to 
process subtrellises in parallel. This approach reduces the number of computations required for 
each subdecoder and speeds up the decoding process. 
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Table 1: Optimum trellis sectionalizations of some RM codes for MAP decoding 


iMj 

Bit-level trellis j 

Optimum sectionalization 


mult. 

add. 

memory 

boundary location 

mult. 

add. 

memory 



66 

55 


112 

86 

33 

RM(16,5) 

700 

218 

195 

{0,4,8,12,16} 

288 

334 

65 


1,020 

458 

195 

{0,2,4,6,8,10,12,14,16} 

712 

574 

109 

umemm 

2,764 

778 

731 

{0,4,8,16,24,28,32} 

784 

1,118 j 

153 



9,594 

4,891 


mm 

HH 

885 


4,748 

2,266 

731 

{0,2,4,6,7,8,10,11,12, 

13,14,16,18,19,20,21, 

22,24,25,26,28,30,32} 

4,064 

2,486 

549 

RM(64,7) 

10,988 

2,922 

2,827 

{0,4,8,16,24,32,40,48, 

56,60,64} 

2,288 

3,710 

457 

RM(64,22yi 

1,500,204 

475,386 

325,051 

{0,2,4,8,16,24,32,40,48, 

56,60,62,64} 

285,256 

664,686 

20,629 

RM(64,42) 

2,197,548^ 

998,394 

325,051 

{0,2,4,8,12,14,16,20,22, 

24,26,28,32,36,38,40,42, 

44,48,50,52,56,60,62,64} 

1,395,352 

1,395,352 

124,453 

RM(64,57) 

20,396 

9,978 

2,827 

{0,2,4,6,7,8,10,11,12, 

13,14,15,16,18,19,20, 

21,22,23,24,25,26,27, 

28,29,30,32,34,35,36, 

37,38,39,40,41,42,43, 

44,45,46,48,49,50,51, 

52,53,54,56,57,58,60, 

62,64} 

18,952 

10,398 

2,453 

. 


Table 2: Best uniform sectionalizations of the MAP algorithm for Reed-Muller Codes 


Codes 

trellis 

multiplication 

RM(8,4) 

2-section* 

112 

RM(16,5) 

4-section* 

288 

RM(16,li) 

8-section* 

712 

RM(32,6) 

4-section 

832 

RM(32,16) 

8-section 

9,728 

RM(32,26) 

8-section 

4,088 

RM(64,7) 

8-section 

2,336 

RM(64,22) 

8-section 

286,528 

RM(64,42) 

16-section 

1,395,616 

RM(64,57) 

32-section 

19,032 
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Table 3: Optimum trellis sectionalizations of some RM codes for Max-Log-MAP decoding 


Codes 

Bit-level trellis 

Optimum sectionalization 


operation 

memory 

boundary location 

operation 

memory 

RM(8,4) 

230 

55 

{0„4,8} 

156 

81 

RM(16,5) 

886 

195 

{0,2,4,8,12,14,16} 

486 

77 

RM(16,11) 

1,446 

195 

{0,2,4,6,8,10,12,14,16} 

1,222 

109 

RM(32,6) 

3,478 

731 

{0,2,4,8,16,24,28,30,32} 

1,510 

165 

RM(32,16) 

35,142 

4,891 

{0,1,3,5,8,12,16,20,24,27,29,31,32} 

22,078 

919 

RM(32,26) 

6,950 

731 

{0,2,4,6,7,8,10,11,12,13,14,16, 

18,19,20,21,22,24,25,26,28,30,32} 

6,446 

549 

RM(64,7) 



{0,2,4,8,16,24,32,40,48,56,60,62,64} 

5,094 

469 

RM(64,22) 

1,975,462 

325,051 

{0,1,3,5,8,10,16,18,24,30, 

32,34,40,46,48,54,56,59,61,63,64} 

905,974 

37,839 

RM(64,42) 

3,195,814 

325,051 

{0,2,4,8,10,12,14,16,18,20,22,24,26, 

28,30,32,34,36,38,40,42,44,46,48,50,52,54, 

56,58,60,62,64} 

2,646,566 

141,925 

RM(64,57) 


2,827 

{0,2,4,6,7,8,10,11,12,13,14,15,16,18,19, 

20,21,22,23,24,25,26,27,28,29,30,32,34, 

35,36,37,38,39,40,41,42,43,44,45,46,48, 

49,50,51,52,53,54,56,57,58,60,62,64} 

29,174 

2,453 


Table 4: Optimum trellis sectionalizations of some RM codes for Log-MAP decoding 


Codes 

Bit-level trellis 

Optimum sectionalization 

operation 

memory 

boundary location 

operation 

memory 

RM(8,4) 

330 

55 

{0,4,8} 

244 

81 

RM(16,5) 

KK&sHi 

195 

{0,1,2,4,8,12,14,15,16} 

866 

83 

RM(16,11) 

2,298 

195 

{0,1,2,3,4,6,8,10,12,13,14,15,16} 

2,242 

115 

RM(32,6) 

4,906 

731 

{0,1,2,4,8,16,24,28,30,31,32} 

2,946 

171 

RM(32,16) 

54,202 

4,891 

{0,1,2,3,5,8,9,12,15,16,17, 

20,23,24,27,29,30,31,32} 

43,906 

1,415 

RM(32,26) 

11,354 

731 

{0,1,2,3,4,6,7,8,10,11,12,13,14,16, 

18,19,20,21,22,24,25,26,28,29,30, 

31,32} 

11,210 

555 

RM(64,7) 

19,370 

2,827 

{0,1,2,4,8,16,24,32,40,48,56,60, 

62,63,64} 

10,690 

475 

RM(64,22) 

2,925,978 

325,051 

{0,1,2,3,5,8,9,12,16,17,20,24,28, 

31,32,33,36,40,44,47,48,52,55,56, 

59,61,62,63,64} 

1,933,682 

63,819 

RM(64,42) 

5,192,346 

325,051 



141,931 

RM(64,57) 

49,946 

2,827 

{0,1,2,3,4,6,7,8,10,11,12,13,14,15,16,18, 

19,20,21,22,23,24,25,26,27,28,29,30,32, 

34,35,36,37,38,39,40,41,42,43,44,45,46, 

48,49,50,51,52,53,54,56,57,58,60,61,62, 

63,64} 

49,618 

2,459 










































































































Table 5: Complexities for the Max-Log-MAP decoding of the (32,16) RM code with 4-section 
trellis 


operations 

entire trellis 

subtrellis 

memory 

2,690 

340 

operations 

30,842 

3,865 



Figure 1: Bit-error performances of the (32,16) RM code with MAP and Max-Log-MAP decoding 
algorithms 
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Figure 2: Bit-error performances of turbo decoding of the (32,16) RM code with MAP and 
Max-Log-MAP decoding algorithms 


Section 1 


Section 2 : Section 3 


Section 4 



Figure 3: 4-section trellis diagram of the (32,16) RM code 
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